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CLEAR  AIR  TURBULENCE  INDICES  DERIVED  FROM  U.  S.  NAVY 
NUMERICAL  MODEL  DATA:  A  VERIFICATION  STUDY 

1.  INTRODUCTION 

The  U.S.  Navy  has  had  a  long-standing  interest  in  atmospheric  phenomena  which 
adversely  affect  aviation  operations  and  flight  safety.  One  of  these  phenomena  is  clear  air 
turbulence  (CAT),  which  results  breaking  gravity  waves  in  strongly  sheared  environments 
in  the  vicinity  of  upper-tropospheric  jet  streams  and  fibntal  zones.  Due  to  CATs  small-scale  and 
relatively  rapid  fluctuations,  its  analysis  and  short-range  forecasting  is  a  difficult  operational 
problem.  An  early  approach  to  CAT  fmecasting  related  upper-air  synoptic  flow  patterns  to  the 
occurrence  of  CAT  (Rammer,  1 973).  More  recently,  this  approach  has  been  broadened  to 
include  empirical  relations  between  CAT  and  satellite  cloud  imagery  (Ellrod,  1985),  and  is  now 
available  as  an  autoinated  expert  system  (Peak,  1991).  At  various  operational  centers,  CAT 
forecasts  are  routinely  issued  in  terms  of  a  turbulence  index  derived  from  numerical  model  data 
(FNOC,  1 98o;  Ellrod  and  Knapp,  1992).  Such  indices  attempt  to  correlate  CAT  occurrence  with 
select  factors  deemed  to  contribute  significantly  to  turbulence  potential. 

In  this  soidy,  two  turbulence  indices  will  be  evaluated  using  gridded  numerical  model 
data  from  the  Navy  Operational  Global  Atmospheric  Prediction  System  (NOGAPS)  collected 
during  the  spring  of  1995.  The  first  is  a  widely-used  CAT  forecasting/diagnostic  algorithm 
described  by  Ellrod  and  KnqTp  (1992)  based  on  horizontal  wind  deformation  and  vertical  wind 
shear.  The  second,  which  has  been  available  operationally  at  the  Fleet  Numerical  Meteorology 
and  Oceanogra^y  Center  (TNMOC)  for  at  least  the  last  two  decades,  uses  vertical  stability  as  its 
forecast  parameter  (FNOC,  1986).  Verification  of  the  two  indices  is  accomplished  by  comparing 
CAT  analyses  and  forecasts  with  pilot  reports  (PIREPs)  obtained  from  the  National  Center  for 
Atmospheric  Research  (NCAR).  The  effect  of  model  resolution  and  forecast  len^  on  CAT 
forecasting  performance  is  examined  in  detail. 
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2.  TURBULENCE  INDICES 


2.1  FUrod(TI) 

An  index  for  clear  air  turb*'(ence  described  by  Ellrod  (19f  9)  is 


TI^DEF*iTfZ 


where  DEF  is  the  deformation  of  the  wind  composed  of  the  stretching  (DST)  and  shearing  (DSH) 
conqxments 


DST  «  au/ax  •  av/ay 
av/ax  +  au/ay 

DEF-(DST^  +  DSHy'*  , 
and  VWS  is  the  vertical  wind  shear 

fws  -  ( (au/azy  +  (av/az)*  . 

Here,  u  and  v  are  the  zonal  and  meridional  wind  components  specified  in  Cartesian  (x,y,z) 
coordinates.  77  values  are  in  units  of  lO'^r^ ,  and  range  (in  this  sf jdy)  from  zero  to  about  18 
units. 


The  choice  of  the  product  of  deformation  and  vertical  wind  shear  for  TI  was  based  on 
correlation  studies  of  these  parameters  to  turbulence  occurrence.  Synoptic-scale  upper-level  flow 
patterns  that  are  associated  with  large  deformation  are  conducive  to  CAT  production.  Large 
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vertical  wind  shear  within  a  stable  layer  exceeding  a  critical  limit  results  in  shearing  instability, 
v^iidt  breaks  down  the  flow  into  turbulent  eddies. 

rNMOC(CCAT) 

The  turbulence  index  in  current  operational  use  at  FNMOC  is  based  on  the  advection  of 
vertical  stability  and  absolute  vorticity.  The  index  is  an  adaptation  of  Theodorsen's  (1954) 
theoretical  fonnuladon  of  turbulence  to  available  numerical  meteorological  data  fields  at  the 
FNMOC.  For  a  predetennined  layer  of  depth  A2,  the  CCAT  index  (FNOC,  1 986)  is  expressed  as 

CG4r  -  i  -i— i  V  •  grad 
T  f 


vdiere  C  and  F  are  the  mean  relative  vorticity  and  wind  vector  for  the  layer, /is  the  Coriolis 
parameter  and  is  the  acceleration  of  gravity.  The  variable  T  is  the  mean  temperature  of  the  layer 
and  is  computed  as  )  >  ^here  and  f,  are  the  temperatures  of  the  upper  and  lower 

levels  of  the  layer.  CCAT  values  are  in  units  of  10^  s’*;  absolute  values  range  (in  this  study)  fiom 
2sro  to  about  37  units. 

As  defined,  the  CCAT  index  can  be  either  positive  or  negative.  When  many  individual 
CCAT  index  fields  are  averaged,  the  rerultant  mean  field  tends  to  be  "noisy”  and  lacking  definite 
structure.  The  choice  of  the  magnitude  O'C-t  absolute  value)  of  CCAT  as  the  turbulence  index 
results  in  a  more  coherent  pattern  structure  in  mean  CCAT  contour  plots.  Based  on  data  in  this 
study,  negative  correlations  are  found  between  turbulence  intensity  and  CCAT  index  values.  On 
the  other  hand,  when  (he  magnitude  of  CCAT  is  used  as  the  turbulence  index,  positive 
correlations  exist  between  index  values  and  turbulence  intensity.  In  this  verification  study,  the 
magnitude  of  CCAT  is  used  as  the  turbulence  index  value. 
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4.  DATA 


3.1  Mod«I 

The  Navy  Operational  Global  Atmospheric  Prediction  System  (NOGAPS)  provided  the 
required  data  for  computation  of  the  turbulence  indices  evaluated  in  this  study.  The  NOGAPS  is 
run  twice  daily  (at  OOZ  and  12Z)  at  the  FNMOC.  Data  for  the  study  is  from  the  NOGAPS 
Version  3.4  forecast  model  which  consists  of  a  multivariate  optimum  mterpolation  analysis,  a 
nonlinear  normal  mode  initialization  scheme,  and  a  159*wave  triangular  truncation  (~  3/4  deg. 
horizontal  resolution),  18-level  spectral  forecast  model  (Hogan  et  al.,  1991;  Ooerss  and  Phoebus, 
1993). 

NOGAPS  data  were  obtained  from  two  distinct  environmental  databases,  both  of  which 
provided  interpolated  meteorologica]  fields  on  standard  constant  press>ire  surfaces.  During  the 
3-month  period  March  through  May  1995,  the  Nr.val  Environmetital  Operational  Nowcasting 
System  (NEONS)  provided  wind  and  geopotential  height  data  required  for  the  TI  calculation  on  a 
2.5*  X  2.5*  spherical  grid.  Although  temperature  data  were  available  in  early  March,  CCAT 
computations  using  NEONS  did  not  commence  until  April  21  when  absolute  (C  f )  vordcity 
fields  became  available.  During  the  second  half  of  May  1995,  meteorological  data  fields 
(u,v,z,T,C)  on  a  360  x  181  spherical  grid  (1  deg.  horizontal  resolution)  were  obtained  using  the 
ISIS  (Integrated  Software  Information  Standard)  environmental  database  at  FNMOC. 

As  available,  meteorological  data  fields  at  both  the  1 .0*  and  2.5  *  horizontal  resolutions 
were  archived  at  three  forecast  lengths  (the  analysis,  and  12  and  24  hours)  and  at  seven  standard 
pressure  levels  (500, 400, 300, 250, 200, 150  and  100  mb).  The  data  were  collected  for  a 
regional  grid  encompassing  the  continental  U.S.  and  adjacent  areas  (viz.,  S*N  -  60*N ,  50*W  • 
130*W). 
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32  PIREPt 


32.1  DeacriptioD 

For  the  period  March  through  May  1995,  a  database  comprising  over  1 19,00C  aircraft 
pilot  reports  was  obtained  from  the  National  Center  for  Atmospheric  Research.  These  PIREPs 
contain  encoded  numeric  data  which  provide  information  on  weather,  cloud  layers,  icing  and 
turbulence.  For  each  PIREP,  up  to  two  turbulence  layers  or  levels  may  be  specified,  each  as  a 
coded  group  containing  turbulence  base  arid  top  heights,  frequency,  intensity  and  type. 

Addidonal  turbulence  information  may  be  available  within  a  PIREP  as  alphanumeric  remarks. 

The  base  and  top  heights  of  a  reported  turbulence  layer  are  generally  specified  to  the 
nearest  thousands  of  feet.  Turbulence  type  is  encoded  as  either  clear  air  turbulence  (CAT),  chop, 
or  low-level  wind  shear  (not  applicable  to  tfds  study).  Since  no  specific  code  is  used  to  report 
mountain  wave  turbulence  (MWT)  or  turbulence  near  thunderstorm  tops  (TNTT),  such 
occunences  can  only  be  ascertained  through  pilot  remarks.  Turbulence  intensity  is  defined 
nutnetically  as  follows :  0)  smooth,  I)  smooth-light,  2)  light,  3)  light-moderate,  4)  moderate,  S) 
moderate-severe,  6)  severe,  7 )  severe-extreme  and  8)  extreme.  For  non-smooth  intensities, 
turbulence  frequency  may  be  specified  as  either  occasional,  intemuttent  or  continuous.  Within  a 
given  PIREP,  a  numeric  value  of  -9'  is  assigned  any  turbulence  code  element  (frequency, 
intensity,  type)  for  which  no  infonnation  is  given. 

322  Selection  Procedure 

Various  criteria  were  opplied  to  the  original  PIREP  database  to  select  those  pilot  reports 
finally  used  as  verification  data  for  model-derived  turbulence  indices.  PIREPs  needed  to  be 
located  within  the  study's  model  grid  domain  and  were  required  to  have  occurred  within  one  hour 
of  OOZ  or  12Z.  Oiven  model  data  at  the  appropriate  date  and  time,  a  PIREP  was  matched  to  the 
grid  point  nearest  to  the  PIREP,  provided  the  report  was  no  more  than  80  km  from  that  model 
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grid  point,  and  at  an  elevation  above  500  mb  (~  5.5  km).  Here,  the  500  mb  height  was 
determined  fiom  the  model's  analysis  (or,  if  unavailable,  the  12  or  24  hr  forecast)  height  at  the 
gridpoint.  For  some  PIREPs,  pilot  remarks  concerning  turbulence  provided  new  ^ir  additional 
information  \riiich  was  numerically  encoded.  However,  those  PKEPs  who?;e  remarics  clearly 
identify  the  cause  of  turbulence  as  due  either  to  convection  or  mountain  waves  were  not  used, 
since neither  turbulence  index  evaluated  herein  is  designed  to  forecast  such  types  of  turbulence. 

Having  passed  the  above  selection  criteria,  a  PIREP's  turhilcnce  information  was 
assigned  (based  on  reported  elevations)  to  o.ne  or  more  of  the  following  constant  pressure  surface 
layers:  500-400  mb,  400-300  mb,  300-250  ml,  250-200  mb,  200-150  mb,  and  150-100  mb.  For 
each  PIREP,  the  base  and  top  height  limits  for  these  layers  were  given  by  model  constant 
pressure  s*irface  heights  at  the  chosen  gric4)oint  PlREPs  within  5  minutes  and  40  km  of  each 
other  were  retained  as  separate  reports  if  their  turbulence  infoimation  was  from  diHerent  layers 
or,  combined  into  one  report,  if  they  provided  information  for  the  same  Layer.  In  general,  for  any 
PIREP  (individual  or  combined)  reporting  two  different  turbulence  inter^jities  within  a  single 
layer,  the  larger  intensity  value  is  selected  for  comparison  with  model-derived  turbulence  indices. 

Since  both  the  71  and  CCAT  indices  forecast  clear  air  turbulence,  it  seems  appropriate  to 
have  mcluded  turbuleiKe  ”  type "  in  the  PIREP  database  selection  process.  Unfortunately,  very 
few  PlREPs  were  identified  .ts  CAT  type.  Thus,  in  order  to  carry  out  this  study,  PlREPs  whose 
"type"  was  not  given  as  well  as  those  described  as  type  "chop"  were  utilized,  on  the  assumption 
that  most  of  these  PlREPs  described  actual  CAT  events  (and  not  MWT  or  TNTT). 

3J23  Distribation 

Two  PIREP  datasets  were  created  for  this  study  -  one  for  comparison  with  NOGAPS  2.5* 
data,  the  other,  for  comparison  'vith  NOOAPS  1.0*  data.  The  2.5*  dataset  is  based  on  1 1 19 
PIREPS  over  the  period  March  through  May  1995;  temporally,  about  two-thirds  of  these  PlREPs 
correspond  to  OOZ  and  one-third  correspond  to  1 2Z.  A  total  of  529  PlREPs  finom  the  second  half 
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of  May  1995  were  used  to  create  the  1.0*  dataset;  temporally,  about  three-fifths  of  these  were  at 
OOZ,  the  remaioder  at  12Z.  The  two  PIREP  datasets  are  not  independent,  since  192  PlREPs  are 
iv»d  mutually. 

Characteristics  of  the  2.S*  PIREP  dataset  are  given  in  Table  1.  Due  to  the  availability  of 
turbulence  information  in  multiple  layers  with  some  PlREPs,  the  total  number  of  Oay^)  reports 
(1281)  is  about  one-sevexrth  larger  than  the  number  of  PlREPs  included  with  this  dataset.  The 
number  of  reports  is  fairly  steady  for  the  lowest  four  layers,  falling  off  dramatically  for  the 
highest  (150-100  mb)  layer.  Only  two  reports  identify  the  turbulence  type  os  "CAT";  over 
three-fourths  of  all  reports  do  not  specify  turbulence  type.  Reports  of  turbulence  fiequency  are 
about  equal  between  "occasional”  and  "continuous";  the  ftequency  "intermittent”  is  seldom 
reported.  In  the  dataset,  about  three-eights  of  all  reports  correspond  to  "smooth"  turbulence,  with 
the  largest  number  of  such  reports  within  the  250-200  mb  layer.  About  half  of  all  turbulence 
intensities  are  either  reported  as  light  or  moderate.  The  overall  percentage  of  reports  of  intensity 
moderate  or  greater  (MOG)  is  about  27%.  Only  about  3%  of  all  reports  identify  turbulence 
intensity  greater  than  moderate;  of  these,  more  than  half  occur  in  the  lowest  two  layers.  Extreme 
turbulence  is  reported  only  once;  the  rather  ambiguous  "smooth-light"  category  is  never  reported. 

Spatially,  the  largest  concentration  cf  PlREPs  included  in  the  2.5*  dataset  occurs  over  the 
southern  Ohio  Valley  (Figure  1).  A  secondary  maximum  is  centered  over  southeastern 
Colorado.  Interestingly,  perhaps  due  to  generally  low  flight  levels,  only  10  PlREPs  (less  than 
1%)  come  fiom  the  heavy  baffic  New'  York-Boston  corridor.  Although  more  actual  cases  of 
MOG  turbulence  are  reported  over  the  Ohio  and  Missouri  Valleys,  50%  or  higher  frequency  of 
MOG  turbulence  (per  5*  x  5*  latitude-longitude  bins  cf  >  3  reports)  only  occurs  over  central 
California,  Montana  and  the  northwest  Gulf  of  Mexico  (including  coastal  Louisiana). 
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Table  1  •  Giancteristics  oi  the  2.5*  PIREP  dataset,  including  the  number  of  reports  according  to 
turbulence  frequency  and  intensity,  and  the  average  base  and  top  heights  (in  ft),  for  selected  layen 
from  SOO  to  100  mb. 


Fij^-urc  1  -  Spatial  distribution  of  Ae  PIREP  2.5*  dataset,  corresponding  to  the  period  March  - 
May  1995.  For  5*  x  5*  latitude-longitude  boxes,  the  total  number  of  PIREPs  and  the  number  of 
MOO  intensity  are  given.  Striped  boxes  indicate  >  50%  MOO  mtensity  reports. 
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The  distribution  of  pilot  reports  for  the  high  resolution  1 .0*  dataset  is  presented  in  Table 
2.  Reflecting  the  late  springtime  period  of  this  dataset,  layer  average  base  and  top  heights  are 
considerably  higher  than  those  for  the  late  winter/spring  2.S*  dataset.  In  general,  the  distribution 
of  turbulence  eleuients  (type,  freq^,jency  and  intensity)  by  categories  is  quite  similar  for  the  1 .0* 
and  2.5*  datasets.  For  example  percentages  of  smooth  intensity  reports  and  those  of  intensity 
M(X}  vary  by  less  than  1%  htaveen  the  two  datasets.  One  slight  difference  is  the  ratio  of 
occasional  to  continuous  turbulence  frequency,  with  ±e  reporting  rado  about  1 ;  1  for  the  2.5* 
dataset  and  about  5:3  for  the  1.0*  dataset  Spatially,  in  agreement  with  the  2.5*  dataset  the  1.0* 
PIREP  dataset  has  the  highest  reporting  density  over  the  southern  Ohio  Valley  with  a  secondary 
maximum  over  eastern  Colorado  (Figure  2).  A  distinct  concentration  of  heavy  turbulence 
(i  50%  fiequency  of  MOO)  is  observed  from  southern  Texas  north-northwestward  to  the  western 
Great  Plains  for  the  1.0*  dataset  Of  any  5*  x  5*  box,  the  one  which  includes  Chicago,  IL  has  the 
highest  number  of  MOO  turbulence  reports. 

4.  RESULTS 

4.1  TI  3>Moatb  Dataset 

For  the  period  March  through  May  1995,  only  model-derived  TI  fields  at  a  2.5* 
horizontal  resolution  are  available  for  verification.  Table  3  presents  average  IT  values  at  selected 
PIREP  mtensity  categories.  One  notes  that  at  all  categories  with  more  than  1 00  data  (categories 
moderate  or  less),  average  T!  values  decrease  slightly  with  forecast  length,  while  overall 
averages  decrease  from  2.17  x  lO"’  at  tau-O  hr  to  1.87  x  lO"’  r*  at  tau*24  hr.  To  examine  the 
relationship  between  intensity  and  average  TI  value,  linear  correlation  coefficients  (based  on  the 
product-moment  formula)  are  computed  for  each  forecast  length.  In  these  computations,  the 
intensity  categories  1  (smooth-light),  7  (severe-extreme)  and  8  (extreme)  are  excluded  due  to 
lack  of  data.  The  very  high  correlations  (r  *  0.99  at  tau^  hr,  r  >  0.8 1  at  tau- 1 2  hr,  r*'  0.96  at 
tau«24  hr)  strongly  suggest  that  the  assumption  of  a  direct  (linear)  reladonship  between 
turbulence  intensity  and  TT  index  value  is  reasonable. 


10 


Table  2  •  Characteristics  of  dte  !  .0*  PIREP  dataset,  including  the  numb^  of  reports  according  to 
turbulence  type,  frequency  and  intensity,  and  the  average  base  and  top  heights  (in  ft),  for  selected  layers 
from  500  to  100  mb. 


AVG.HGT. 

BASE 

TOP 


NO.RPTS. 


TYPE 

CAT 

CHOP 

NOT  GIVEN 


FREQUENCY 
NO  (SMOOTH) 
OCCASIONAL 
INTERMl’n'ENT 
CONTINUOUS 
NOT  GIVEN 


INTENSITY 

SMOOTH 

SMOOTH-LGT. 

LIGHT 

UGHT-MOD. 

MODERATE 

MOD.-SEVERE 

SEVERE 

SEVERE-EXT. 

EXTREME 

NOT  GIVEN 


LAYER(MB) 


S00>400  400-300  300-250  250-200  200-150  150-100  500-100 


18793  24278 

24253  30935 


Figure  2  -  Spatial  distribution  of  the  PIREP  1.0*  dataset,  correspondinj  to  the  period  May  15-31, 
1995.  For  5*  x  5*  latitude-longitude  boxes,  the  total  number  of  PIREPs  and  the  number  of  MOO 
intensity  are  given.  Striped  boxes  indicaie  a  50%  MOG  intensity  reports. 
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Table  3  •NOGAPS  2.S*  average  Tl  values  (units  10*^  s'^)  and  number  of  data  for  selected  PIREP 
intensity  categories,  at  tau  *  0, 12,  and  24  hr,  for  the  period  March>May  1995. 


TAU» 

OHR 

TAU-12HR 

TAU-24HR 

INTENSITY 

NO.  DATA 

AVG.T1 

NO.  DATA 

AVG.TI 

NO.  DATA 

AVG.T1 

SMOOTH 

421 

1.60 

442 

1.56 

432 

1.47 

SMOOTH-LGT 

0 

0 

0 

.... 

UGHT 

312 

2.21 

322 

1.89 

300 

1.88 

LGT-MODERATE 

116 

2.55 

no 

2.36 

109 

2.28 

MODERATE 

287 

2.70 

304 

2J0 

298 

2.20 

MOD-SEVERE 

13 

2.90 

IS 

3.20 

16 

2.69 

SEVERE 

20 

3.16 

20 

2.45 

18 

2.63 

SEV-EXTREME 

0 

0 

0 

EXTREME 

1 

0.80 

1 

I.IO 

1 

1.20 

ALL 

1170 

2.17 

1214 

1.94 

1174 

1.87 

Table  4  •  Distribution  of  reported  intensities  for  a  range  of  NOGAPS  2.5*  Tl  index  values  (units  10*^  s**), 
at  tau  *  0  hr. 


TT  INDEX  (TAU- 

OHR) 

INTENSITY 

0.<2 

2-<4 

4-<6 

6- <8 

8-<10 

10.<12 

12- <14 

14-  <16 

SMOOTH 

302 

81 

n 

n 

HnH 

m 

BB 

SMOOTH-LOT 

0 

0 

■■ 

^9 

■■ 

mM 

LIGHT 

183 

84 

mm 

14 

4 

LOT-MOD 

63 

29 

mSM 

1 

3 

1 

Bfl 

MODERATE 

152 

37 

9 

3 

10 

Bfl 

MOD-SEVERE 

7 

0 

3 

0 

0 

BB 

SEVERE 

9 

mM 

2 

2 

1 

1 

BH 

Bfl 

SEV-EXTREME 

0 

mm 

0 

■■ 

0 

Bl 

Bfl 

EXTREME 

1 

0 

n 

0 

0 

Bfl 

Bfl 

MOO 

169 

79 

39 

14 

UM 

11 

4 

1 

ALL 

717 

273 

107 

38 

m 

17 

5 

1 
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The  distribution  of  reported  intensities  with  NOGAPS  2.3*  TI  analysis  (tau  -  0  hr) 
values  is  given  in  Table  4.  One  notes  a  wide  range  of  intensities  for  a  given  Tl  index  value 
<12x10'^  s'^  suggesting  low  skill  of  the  TI  index  in  individual  forecasting  of  turbulence 
intensity.  Based  on  1 1 70  forecasts,  the  linear  correlation  coefficient  relating  intensity  and  TI  is 
small  (r  *  0.21 1)  yet  sufficiently  removed  from  zero  (no  correlation).  Interestingly,  this  value  is 
almost  identical  to  the  value  r  =*  0.219  reported  by  McC^ann  (1993)  who  conelated  567  turbulence 
intensities  with  TI  values  derived  fiom  gridded,  objective  analyses  of  upper-air  rawinsonde  data. 
Given  correlation  coefficients  r  -  0.180  and  r  ■  0.187  at  tau  “  12  and  24  hr,  respectively,  no 
significant  degradation  of  forecasting  skill  with  lead  time  is  noted  for  the  NOGAPS  2.S*  TI 
index. 


To  Anther  examine  the  quality  of  TI  (and  later,  CCAT)  forecasts,  three  contingency  table 
statistical  indices  •  the  probability  of  detection  (POD),  the  false  alarm  rate  (FAR)  and  the  critical 
success  index  (CSI)  •  are  computed.  Given  a  particular  event  (viz.,  MOO  turbulence),  the 
probability  of  detection  is  the  capability  of  correctly  forecasting  that  event,  and  is  defined  as  the 
number  of  c'lrrect  (model)  forecasts  divided  by  the  number  of  reported  occurrences.  The  false 
alarm  rate  is  a  measure  of  tite  tendency  to  overforecast,  and  is  defined  as  the  number  of  incorrect 
forecasts  divided  by  the  number  of  forecast  issued.  As  a  measure  of  overall  forecast  skill,  the 
critical  success  index  (or  threat  score)  is  defined  as  the  number  of  correct  forecasts  divided  by  the 
sum  of  the  number  of  observed  events  and  incorrect  forecasts.  Two  TI  threshold  values  (2  and  4 
X  10'^  are  selected  for  detecting  moderate  or  greater  turbulence;  both  these  values  were  used 
by  Rlbod  and  Knapp  (1992)  m  verification  of  TT  index  derived  from  numerical  models.  Based 
on  NOGAP3  2.3*  analysis  data  (Table  4),  slightly  more  than  half  (three-fourths)  of  all  MOO 
turbulence  reports  occur  at  TI  values  <  2  (<  4);  these  percentages  increase  slightly  with  lead  time 
(i.e.,  at  tau  12  and  24  hr ). 

Performance  statistics  of  the  TI  index  for  0, 1 2  and  24  hr  NOOAPS  2.3*  forecasts  are 
given  in  Table  5.  At  the  higher  TI  threshold  value,  a  slight  decrease  In  POD  and  CSI  values 
occurs  over  the  0  to  24  hr  forecast  length.  Performance  statistics  for  the  2  x  10'''  r*  threshold 
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value  are  more  steady  with  lead  time;  the  FAR  actually  improves  very  slightly  fi-om  0  to  24  hr 
(the  lower  the  score,  the  better).  More  significant,  POD  and  CSI  statistics  are  considerably  higher 
at  the  lower  (  2  x  IQ"’  s'*)  TI  threshold  value,  while  FAR  values  are  only  slightly  higher.  The 
improvement  in  forecast  performance  is  most  dramatic  at  tau  «  24  hr,  where  the  CSI  score  at  the 
lower  71  threshold  value  is  two  times  higher  than  at  the  higher  (4x10'^  s*^ )  threshold  value  and 
the  POD  score  is  tiuee  times  higher. 


Table  S  •  NOGAPS  2.S*  M^h-May  1995  71  performance  statistics  at  tau  >  0, 12  and  24  hr,  for  two 
selected  71  threshold  values.  Statistics  based  on  MOG  turbulence  evMts. 


IxlO’r* 

TI  THRESHOLD  VALUE 

4xl0-’f* 

TAU 

POD 

FAR 

CSI 

POD 

FAR 

CSI 

OHR 

0.474 

0.664 

0.244 

0.227 

0.594 

0.171 

12  HR 

0.447 

0.651 

0.244 

0,171 

0.136 

24  HR 

0.420 

0.644 

0.239 

0.141 

0.621 

0.115 

Although  Table  5  performance  statistics  (for  the  11 2  x  10^^  s'^  threshold)  indicate  some 
Jdll  in  forecasting  MOG  turbulence  conditions,  these  statistical  values  are  considerably  ^vorse 
than  those  reported  by  Ellrod  (1989).  In  his  validation  study,  based  on  analysis  (tau  ■■  0  hr)  data 
from  a  numerical  model  of  similar  resolution  as  NOOAPS  and  a  TI  threshold  value  of  4  x  10'^ 
Ellrod  reported  a  70%  POD,  a  20%  FAR  and  a  60%  CSI  for  the  TI  index.  The  large  difference  in 
forecasting  skill  between  this  study  and  Ellrod’s  results  primarily  from  significant  differences  in 
verification  techniques.  Specifically,  this  study's  verification  criteria  is  much  more  restrictive  - 
for  a  correct  forecast,  turbulence  needs  to  occur  within  a  rather  shallow  vertical  layer  and  limited 
horizontal  area  (of  radius  80  km  from  the  nearest  model  grid  poim).  On  the  other  hand,  Ellrod's 
verification  criteria  permits  a  successful  forecast  to  occur  over  a  considerably  deeper  layer  and 
potentially  a  much  larger  (perhaps  by  a  factor  of  ten)  horizontal  area. 
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A2  Index  ComparUoiu 
A2.1  2.5  Deg.  Reiohition 

During  the  period  late  April  through  May  1995,  a  total  of  75  NCX3APS  2.5*  forecast  runs 
(38  at  12Z,  37  at  OOZ)  axe  available  for  coincidental  computation  of  Tl  and  CCAT  index  fields. 
Average  analysis  (tau  -  0  hr)  fields  of  the  TI  and  CCAT  (magnitude)  indices,  for  the  250-300  mb 
layer,  are  presented  in  Figures  3  and  4,  respectively.  On  comparison,  one  notes  that  the  structural 
pattern  of  both  these  average  fields  is  quite  similar.  As  expected,  due  to  the  presence  of  strong 
jet  streams  and  fiequent  cyclogenesis,  largest  values  for  both  indices  are  concentrated  within  the 
mid-latitudes;  smallest  values  occur  over  the  tropics  and  high  latitudes.  Both  fields  exhibit 
maxima  over  Colorado  and  the  northeastern  Unites  States  (New  England  and  adjacent  areas). 
Interestingly,  the  TI  and  CCAT  maxima  over  Colorado,  and  the  CCAT  maximum  over  Ohio, 
occur  in  regions  which  contain  high  frequencies  of  turbulence  reports  during  the  late  April-May 
period  (see  Figures  I  and  2).  In  a  climatological  sense,  both  the  TI  and  CCAT  indices  appear 
oqtable  of  identifying  regions  of  high  risk  for  clear  air  turbulence. 

Table  6  presents  linear  correlation  coefficients  and  average  index  values  for  NOGAPS 
2.5*  TI  and  CCAT  (magnitude)  forecasts,  for  the  period  late  April-May  1995.  These  statistics 
are  based  on  about  500  coincidental  TI  aixi  CCAT  forecasts,  of  which  only  about  29% 
correspond  to  forecasts  of  MOG  turbulence  events.  Both  Tl  and  CCAT  average  forecast  values 
decrea.se  slightly  with  increasing  forecast  I  ngth.  Correlation  coefficients  for  both  indices 
indicate  no  degradation  in  forecasting  skill  with  lead  time,  with  correlation  values  highest  at  tau 
*  12  hr.  Most  significant,  correlation  coefficients  are  much  higher  (by  about  0.2)  for  TI  than 
those  for  CCAT.  While  the  correliition  coefficients  for  the  TI  index  (from  0.223  to  0.265) 
indicate  marginal  skill  in  forecasting  turbulence  intensity,  the  very  low  CCAT  correlation  values 
(slightly  above  zero)  indicate  essentially  no  skill  for  this  index  in  forecasting  any  individual 
turbulence  event  which  could  span  a  wide  spectrum  of  intensities  (i.e.,  smooth  through  severe). 
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Figure  4  -  Avertge  analysis  (tau  ■  0  hr)  field  of  the  CCAT  (magnitude)  index  (units  -  1 0  *  s  ’), 
for  the  250-300  mb  layer,  derived  from  NOGATS  2.5*  dau  during  the  period  April  21  -  May  31, 
1995. 


Table  6  -  Correlation  coefficients  and  average  index  values  for  NOGAPS  2.S*  coincidental  TI  and  CCAT 
(magnitude)  0, 12  and  24  hr  forecasts,  for  the  period  April  21  •  May  31, 199S. 


TI  INDEX  CCAT  INDEX 


TAU 

NO.  DATA 

AVO.  (10*’ r*) 

r 

AVQ.(10-»s*’) 

r 

Ohr 

505 

mssm 

0.011 

■Oh 

495 

0.048 

485 

0.232 

3.48 

0.019 

In  order  to  compare  NOGAPS  2.5*  TI  and  CCAT  performance  statistics,  CCAT  threshold 
valuesofBxlO^s'^andbxlO^sr’  are  chosen  for  prediction  ofMOG  turbulence  events.  These 
values  provide  similar  distribution  statistics  of  reported  turbulence  intensity  versus  index  value 
as  the  threshold  values  previously  chosen  for  TI.  Specifically,  for  this  dataset,  the  percentage  of 
MOG  turbulence  reports  ^ch  occur  below  a  CCAT  (magnitude)  threshold  value  of  3  x  10**  s^ 

(6  X 10**  r*)  ranges  from  55  to  62%  (79  to  81%)  for  0, 12  and  24  hr  forecasts;  for  coincidental  TI 
forecasts,  percentages  range  from  57  to  63%  (82  to  86%)  at  the  2  x  10**  (4  x  10*''  s*^  threshold 

value.  Given  the  similarities  in  ficquency  distribution,  direct  comparisons  will  be  made  between 
statistics  based  on  the  lower  (and  the  higher)  TI  and  CCAT  threshold  values. 

.  « 

Performance  statistics  for  NOGAPS  2.5*  TI  and  CCAT  (magnitude)  forecasts,  at 
selected  threshold  values,  are  given  in  Table  7.  For  both  the  TI  and  CCAT  indices,  POD  and  CSI 
0, 12  and  24  hr  statistics  are  considerably  higher  at  their  respective  lower  threshold  value,  while 
frdse  alarm  rates  are  lower  (i.e.,  better)  at  the  higher  threshold  values  (except  for  CCAT  at  tau 
12  hr).  For  both  CCAT  thresholds,  FAR  scores  are  high  (near  0.7).  A  comparison  of  TI  and 
CCAT  statistics  at  their  respective  lower  threshold  values  shows  very  similar  POD  values  (near 
0.4)  at  all  forecast  lengths.  In  this  same  comparison,  CSI  values  arc  slightly  better,  and  FAR 
scores  considerably  better,  for  the  TI  index.  For  both  TI  threshold  values  and  the  lower  CCAT 
threshold  value,  all  three  statistical  indices  were  best  at  tau  »  12  hr.  For  this  dataset,  there  was  no 
df  gradation  of  forecast  skill  over  the  0  to  24  hr  interval  for  any  TI  or  CCAT  performance 
statistic,  at  any  threshold  value. 
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Table  7  -  (a)  NOGAPS  2.5*  Tl  performance  statistics  at  tau  ••  0, 12  and  24  hr,  for  two  selected  TI 
threshold  values,  (b)  Same  as  (a)  except  for  CCAT  (magnitude).  Statistics  based  on  MOG  turbulence 
events  and  coincidental  TI  and  CCAT  forecasts  over  the  period  April  21 -May  31,  1995. 


(a)  n  THRESHOLD  VALUE 

2xl0*’r' 

4xl0-'s* 

TAU 

POD 

FAR 

CSI 

POD 

FAR 

CSI 

Ohr 

0.421 

0.643 

0.239 

0.179 

0.544 

0.148 

12  hr 

0.595 

0.264 

0.181 

0.469 

0.156 

24  hr 

0.618 

0.231 

0.142 

0.535 

0.122 

(b)  CCAT  THRESHOLD  VALUE 

3xl0^s-* 

6x1(7*$** 

TAU 

POD 

FAR 

CSI 

POD 

FAR 

CSI 

Ohr 

j 

0.196 

0214 

IH 

12  hr 

0.451 

0.229 

0.194 

!  -MM 

24  hr 

0.376 

0.710 

0.196 

0.206 

0.147 

4jL2  1.0  Deg.  Resoladon 

Average  index  values  and  linear  correlation  coefficients,  for  NOGAPS  1.0*  TI  and  CCAT 
(magnitude)  0, 12  and  24  hr  forecasts  during  the  period  May  15*31  1995,  are  presented  in  Table 
8.  These  statistics  are  based  on  543  (tau  «  24  hr)  to  580  (tau  *  0  hr)  coincidental  Tl  arid  CwAT 
forecasts,  of  which  about  28  %  correspond  to  forecasts  of  MOO  turbulence  events.  For  both  11 
and  CCAT,  average  forecast  values  are  highest  for  the  analysis  (tau  ">  0  hr)  and  about  the  same 
for  12  and  24  hr  forecasts.  Tl  linear  correlation  coefficients  decrease  slightly  with  lead  time 
(from  r  *  0J271  at  tau  *  0  hr  to  r  ■■  0.21 1  at  tau  24  hr).  These  correlation  vtdues  (con^>arable  to 
those  for  the  NOGAPS  2.5*  late  April-May  dataset)  suggest  that  the  TI  index  has  only  a  very 
limited  ability  in  distinguishing  between  smooth  and  heavy  (MOG)  turbulence  conditions.  For 
CCAT,  the  largest  correlation  coefficient  (r  «  0.140)  occurs  at  tau  24  hr,  this  value  cannot  be 
considered  representative  of  any  useful  skill  in  the  forecasting  of  any  arbitrary  (smooth  through 
severe)  turbulence  event. 

Table  9  presents  performance  statistics  for  NOGAPS  1.0*  Tl  and  CCAT  (magnitude) 
forecasts  of  MOG  turbulence  events.  For  this  high  resolution  dataset,  the  CCAT  threshold  value 
4  X  10^  s  ’  (8  X  10**  r’)  provides  the  best  similarity  to  the  TI  threshold  2  x  10  ’  s  ’  (4  x  10*’  s'*)  in 
regards  to  index  value  versus  intensity  frequency  distribution.  Statistics  based  on  the  previously 
used  CCAT  threshold  3  x  1(^*  s'*  ( 6  x  10**  s**)  are  not  best  suited  for  direct  comparisons,  since 
the  percentage  of  MOO  turbulence  reports  uiiich  occur  below  this  CCAT  threshold  value 
averages  about  10%  less  than  the  percentage  corresponding  to  the  Tl  2  x  10’ s*’  ( 4  x  10*’  s  ’) 
threshold  value.  Table  9  POD  and  CSI  statistics  for  TI  and  CCAT  forecasts  (at  threshold  values 
4  X  10*’  s'*  and  8x10**  r*,  respectively)  are  quite  similar  at  tau  0  and  12  hr,  but  CCAT  values 
are  slightly  higher  at  tau  «  24  hr.  For  this  same  comparison,  FAR  scores  are  considerably  lower 
(by  about  0. 1 7  to  0. 1 9)  for  the  TI  index.  For  both  TI  and  CCAT,  a  decrease  in  threshold  value 
results  in  a  significant  improvement  in  both  POD  and  CSI  statistics;  unfortunately,  such  a 
decrease  also  re.<mlts  in  considerably  greater  FAR  scores  for  the  TI  index.  Except  for  the  POD 
statistic  a4  uu  -  24  hr,  ail  performance  statistics  for  Tl  at  the  2  x  10*’  r’  threshold  value  are 


Table  8  -  Correlation  coefficients  and  average  index  values  for  NOGAPS  1.0*  coincidental  TI  and  CCAT 
(magnitude)  0, 12  and  24  hr  forecasts,  for  the  period  May  15  •  3 1, 1995. 


n  INDEX  CCAT  INDEX 


TAU 

NO.  DATA 

AVG.(10-’t>) 

r 

AVG.(lO^r’) 

T 

Ohr 

580 

■H 

■m 

WmM 

0.091 

579 

0.077 

■BiiiH 

543 

■91 

0.211 

0.140 

Table  9  •  (a) NOGAPS  I.O*  TI  performance  statistics  at  tau  »  0, 12  and  24  hr,  for  selected  Tl  threshold 
values,  (b)  Same  as  (a)  except  for  CCAT  (magnitude).  Statistics  based  on  MOG  turbulence  events  and 
coincidemal  TI  and  CCAT  forecasts  over  the  period  May  15  •  3 1,  1995. 


2x  lO-’s 

(a)  TI  THRESHOLD  VALUE 

2 

4xl(7’s» 

TAU 

POD 

FAR 

CSI 

POD 

FAR 

CSI 

EH 

0.439 

Bf!  uB 

mm 

msM 

JQjjHj 

•HQ 

KH 

0.242 

0.400 

HOI 

(b)  CCAT  THRESHOLD  VALUE 

3x10^  s’ 

4  X  lO'*  S'* 

8xl0-»r» 

TAU 

POD  FAR 

CSI 

POD 

FAR  CSI  POD 

FAR 

CSI 

Ohr 

0.494  0.680 

0.241 

0.421 

0.644  0.239  0.189 

0.648 

0.140 

12  hr 

0.47S  0.658 

0.377 

0.659  0.218  0.148 

0.662 

0.115 

24  hr 

0.523  0.665 

0.256 

0.431 

0.658  0.216  0.216 

0.566 

0.168 
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sliglitly  better  than  comparable  statistics  for  CCAT  at  a  threshold  value  of  4  x  1  O'’  s‘^  A 
comparison  of  CCAT  statistics  (Table  9(b))  indicates  that  a  slight  decrease  in  threshold  value 
(from  4  to  3  X 10'’  ar*)  results  in  considerably  better  forecast  capability  (POD  ~0.5)  yet  little  if 
any  increase  in  overforecasting.  Taken  collectively,  POD,  FAR  and  CSl  statistics  do  not  indicate 
any  definitive  degradation  of  forecasting  skill  with  lead  time  for  either  predictor,  at  any  threshold 
value. 

4.2  J  1.0  Venus  2J  Deg.  Resolution 

Tlie  availability  of  NOGAPS  gridded  fields  at  both  a  high  (1 .0*)  and  a  low  (2.S*) 
horizontal  resolution  during  the  second  half  of  May  1995  permits  an  assessment  of  TI  and  CCAT 
forecasting  skill  in  terms  of  data  resolution.  Differences  in  model-derived  TI  (or  CCAT)  index 
values  at  1 .0  *  and  2.5*  resolutioos  essentially  reflect  frie  effect  of  interpolation  from  actual 
model  data  representation  (spherical  harmonics)  and  resolution  (3/4  deg.,  75-80  Ion)  to  each  of 
these  horizonttd  grid  resolutions.  Based  on  about  200  coincidental  data,  average  forecast  values 
for  both  the  TI  and  CCAT  (magnitude)  indices  are  all  somevdiat  larger,  at  each  forecast  length,  at 
the  higher  (1 .0*)  resolution  (Table  10).  Based  on  analysis  data,  linear  correlation  coefficients  for 
TI  and  CCAT  are  higher  at  the  1.0*  resolution;  however,  at  tau  ■  12  and  24  hr,  the  reverse 
occurs,  with  correlation  values  higher  at  the  lower  (2.5*)  .-esolution.  As  in  previous  comparisons, 
correlation  coefficients  for  TI  are  significantly  higher  than  those  for  CCAT.  With  an  average 
correlation  value  r  «  0.25  (Table  10),  TI  shows  some  ability  (albeit  quite  small)  in  forecasting 
any  arbitrary  (smooth  through  severe)  turbulence  event. 

Performance  statistics  for  TI  0, 12  and  24  hr  forecasts,  derived  from  coincidental  1 .0*  and 
2.5"  NOGAPS  data,  are  presented  in  Table  11.  At  the  2  x  lO'’  s'*  threshold  value,  both  POD  and 
CSI  statistics  at  tau  ■  0  and  24  hr  are  somewhat  higher  for  high  resolution  forecasts.  For  12  hr 
forecasts,  FAR  and  CSI  statistics  are  marginally  better  when  based  on  2.5  *  data,  while  POD 
values  are  identical  at  the  1.0*  and  2.5*  resolutions.  For  the  higher  forecast  threshold  (4x10*’ 
S’*),  all  statistics  (POD, FAR, CSI)  are  marginally  better  at  tau  ■  0  and  1 2  hr  for  forecasts  based  on 


Table  10  -  (a)  Correlation  coefficients  and  average  index  values  for  NOGAPS  coincidental  1 .0*  and  l.S* 
tIO,  12  and  24  hr  forecasts  for  the  period  May  IS>3].  1995.  (b)  Same  as  (a)  except  for  CCAT 
(magnitude). 


(a)  n  INDEX 

1.0  DEG.  RESOLUTION 

2.5  DEG.  RESOLUTION 

TAU 

NO.  DATA 

AVG.  (lO-'r*) 

r 

AVG.dO-’r’) 

r 

Ohr 

201 

MEM 

■w 

mSEM 

198 

0J34 

Hal 

199 

1.65 

0.236 

1.41 

0.263 

(b)  CCAT  INDEX 

1.0  DEG.  RESOLUTION 

2.5  DEG.  RESOLUTION 

TAU 

NO.  DATA 

AVG.{!0^r’) 

r 

AVG.(10^r>) 

r 

Ohr 

WMM 

4.44 

3.58 

mmm 

12hr 

4.24 

3.24 

24  hr 

HudH 

3.59 

0.048 

2.92 

0.100 

Table  1 1  •  (a)  NOCAPS  coincidental  !.0*  and  2.5*  TI  perfonnance  statistics  at  tau  0, 12  and  24  hr,  for 
a  TI  threshold  of  2  x  10*^  s'^.  (b)  Same  as  (a)  except  for  71  threshold  4x10'''  r*.  Stahitics  based  on 
MOG  turbulence  events. 


(a)  TI  IHRESHOLD  VALUE  2  X  10-' r* 

1.0  DEG.  RESOLUTION  2.5  DEG.  RESOLUTION 

TAU 

POD 

FAR 

CSI 

POD 

FAR 

CSI 

Ohr 

0.418 

0.509 

0.292 

0J5I 

WBM 

12  hr 

0.549 

0.245 

0J4I 

WSSM 

24  hr 

0.375 

0.5 1C 

0.297 

0.229 

(b)  TI  THRESHOLD  VALUE  4x  10-'s-> 

1.0  DBG.  RESOLUTION 

2.5  DEG.  RESOLUTION 

TAU 

POD 

FAR 

CSI 

POD 

FAR 

CSI 

Ohr 

0.209 

BBH 

0.194 

0.350 

0.176 

12  hr 

0.136 

0.106 

0.417 

24  hr 

0.156 

0.167 

0.152 

0.156 

0.167 

0.152 
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the  higher  resolution  data.  At  tau  »  24  hr,  all  statistics  are  identical  at  both  resolutions;  the  very 
low  FAR  (0.167)  results  from  only  2  (out  of  12)  incorrect  forecasts  of  MOG  turbulence. 

Table  12  presents  CCAT  (magnitude)  performance  statistics  at  two  selected  thresholds  (3 
and  4  X  10^  s'^)  for  coincidental  1.0*  and  2.5*  forecasts.  At  all  forecast  lengths,  comparisons  of 
CCAT  high  and  low  resolution  POD  and  CSI  statistics  indicate  higher  (an  -  in  a  few  cases, 
considerably  higher)  values  for  forecasts  based  on  the  1 .0*  data.  FAR  analysis  scores  at  both 
threshold  values  an  somewfiat  better  using  1.0*  data;  however,  no  significant  differences  in  1.0* 
and  2.5  *  FAR  scores  occur  for  12  and  24  hr  forecasts.  For  both  CCAT  high  and  low  resolution 
forecasts,  a  noticeable  improvement  in  POD  and  CSI  (most  especially,  POD)  statistics  coupled 
with  only  minor  fluctuations  in  FAR  scores  occurs  when  the  forecast  threshold  is  decreased  fiom 
4  to  3  X 10^  s*^.  Comparing  TI  and  CCAT  statistics  (Tables  1 1  and  12),  an  improvement  ( i.e., 
decrease)  in  NOGAPS  data  resolution  (&om  2.5  *  to  1 .0*)  appears  more  beneficial  to  the 
forecasting  performance  oftbe  CCAT  index.  This  probably  occurs  because  the  CCAT 
formulation  contains  a  very  small  quantity  (the  vorticity,  in  units  of  lO"*  s*')  which  is  likely  quite 
sensitive  to  intetpolation  processes  involved  in  converting  from  model  to  gridpoint 
representation. 

5.  SUMMARY  AND  CONCLUSIONS 

Two  turbulence  algorithms  for  forecasting  clear  air  turbulence  are  computed  using 
meteorological  data  from  the  Navy  Operational  Global  Atmospheric  Prediction  System 
(NOGAPS)  model.  The  TI  index  is  based  on  defonnation  and  vertical  wind  shear,  and  is  used  at 
several  operational  centers  in  support  of  aviation  forecasting.  The  CCAT  index,  in  current 
operational  use  at  FNMOC,  is  based  on  the  advection  of  vertical  stability  and  absolute  vorticity. 
Verification  of  both  algorithms  is  accomplished  by  comparing  model*derived  analyses  and 
short-range  forecasts  with  pilot  reports  of  turbulence  intensity  over  the  contin  ental  U.S.  during 


Table  12  •  (a)  NOGAPS  1.0*  and  2.S*  coincidental  CCAT  (magnitude)  performance  statistics  at  tau  •*  0, 
12  and  24  hr,  for  a  CCAT  threshold  of  3  x  10^  s'*,  (b)  Same  as  (a)  except  for  CCAT  threshold  4  x  10'* 
S’*,  Statistics  based  on  MOG  turbulence  events. 


(a)  CCAT  THRESHOLD  VALUE  3  X  10’»  S’* 

1 .0  DEG.  RESOLUTION  2.5  DEG.  RESOLUTION 

TAU 

POD 

FAR 

CSI 

POD 

FAR  CSI 

Ohr 

0.619 

0.585 

0.331 

0.397’ 

0,653  0.227 

12  hr 

0.642 

0.580 

0.574 

0.574  0.315 

24  hr 

0.509 

0.679 

024S 

0.377 

0.672  0.213 

(b)  CCAT  THRESHOLD  VALUE  4xia*r* 

lODEG.RESOLUnON 

2.5  DEG.  RESOLUTION 

TAU 

POD 

FAR 

CSI 

POD 

FAR  CSI 

Ohr 

0.492 

0.551 

0.307 

0.317 

12  hr 

0.576 

0.308 

0.377 

24  hr 

0.358 

0.694 

0.198 
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die  spring  of  1995,  The  forecasting  capability  of  each  turbulence  index  is  evaluated  statistically 
in  terms  of  forecast  (decision)  threshold,  model  data  resolution,  and  length  of  forecast 

The  major  findings  of  this  verification  study  are  as  follows; 

(1)  Correlations  between  turbulence  intensity  and  index  value  indicate  that  the  magnitude 
of  CCAT  (and  not  CCAT)  is  the  preferred  turbulence  predictor. 

(2)  Climatologically.  both  TI  and  CCAT  ^pear  capable  of  identifying  high>turbulence 
threat  regions. 

P)  The  TI  index  shows  nuurginal  skill  (r  »  0.25),  and  the  CCAT  index  essentially  none,  in 
the  forecasting  of  any  arbitrary  (smooth  through  severe)  turbulence  event 

(4)  For  a  threshold  value  2  x  10*’  s*’,  average  TI  1 ,0*  and  2.5*  statistics  (Tables  7  and  9) 
for  forecasting  MOG  turl-olence  events  are:  POD  -  0.4 1,  FAR  »  0.60  and  CSI  =  025. 
Coincidental  statistics  for  CCAT  ( threshold  value  3x10^’  s*^)  are  quite  similar,  with  POD  ■■ 
0.45,  FAR  »  0.69  and  CSI «  0.23.  Overforecasting  is  a  serious  problem  for  both  indices,  most 
especially  for  CCAT. 

(5)  Collectively,  comparisons  among  analysis,  12  an  1 24  hr  statistics  do  not  indicate  any 
definitive  trend  in  forecasting  skill  with  lead  time,  although  average  forecast  TI  and  CCAT  index 
values  geiKrally  show  a  slight  decrease  with  forecast  length. 

(6)  The  use  of  high  (1.0*)  resolution  data  (as  opposed  to  2.5*  data)  provides  slightly 
improved  forecasting  capability  to  the  CCAT  index,  especially  in  POD.  Such  improvement  in 
tbrecasting  ability  using  higher  resolution  data  is  noticeably  less  for  the  TI  index. 


Although  certainly  not  clear-cut,  overall  statistical  results  of  this  study  indicate  a  slight 
preference  of  the  TI  index  over  CCAT  for  operational  use.  In  addition  to  slightly  better 
performance,  the  TI  algorithm  is  computationally  more  simple,  depending  only  upon  wind  and 
height  data.  Unfortunately,  with  high  false  alarm  rates  and  only  modest  capability  of  correctly 
forecasting  observed  MOG  turbulence  events,  both  of  the  turbulence  indices  appear  limited  to 
providing  operational  users  only  "rough”  estimates  of  encountering  significant  clear  air  turbu¬ 
lence  over  specified  regional  areas. 

In  this  study,  only  data  fiom  a  global  numerical  model  was  used  to  forecast  CAT.  With 
ever-increasing  computer  power,  it  is  now  feasible  to  run  forecast  models  with  resolutions 
similar  to  those  in  which  CAT  occurs.  One  such  model  -  CO  AMPS,  or  Coupled 
Ocean/Atxnosphere  Mesoscale  Prediction  System  (Hodur,  1993)  -  is  presently  being  readied  for 
operational  implementation  at  FNMOC.  COAMPS  typically  runs  at  horizontal  resolutions  <  20 
km  and  can  be  configured  to  run  at  vertical  resolutions  of  several  hundreds  of  meters  within  the 
free  atmosphere;  its  physics  include  explicit  predictions  of  turbulent  kinetic  energy  (TKE). 
When  operational,  COAMPS  should  be  evaluated  for  turbulence  forecasting  potential,  either  by 
computing  diagnostic  indices  (such  as  TI  and  CCAT)  or,  more  challengingly,  by  relating  model 
TKE  predictions  to  in-flight  turbulence. 
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